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Chapter 1 

ELEC 302: State Space Systems 
Overview 1 

1.1 "The Mars Global Surveyor" 

"Mars Global Surveyor" 




Figure 1.1 



1 This content is available online at <http://cnx.Org/content/m2100/2. 9/>. 



2 CHAPTER 1. ELEC 302: STATE SPACE SYSTEMS OVERVIEW 

The Mars Global Surveyor, built by Lockheed Martin and launched by NASA, orbits our nearest planetary 
neighbor on a mission to map the surface of Mars and catalogue scientific data . The Surveyor spacecraft 
left Cape Canaveral, Florida aboard a Delta- 7925 rocket, and then spent 300 days traveling approximately 
750 million kilometers to reach Mars in September of 1997. After the Mars Global Surveyor reached Mars, 
it used its main rocket engine to lower itself into an elliptical orbit around the planet. The spacecraft then 
spent the next one and a half years reducing its orbit by using the friction between itself and the atmosphere 
of Mars to slow down and thus lose 55,000 km of altitude. In March of 1999, the Surveyor spacecraft began 
its mapping of the Martian surface. The motion of this spacecraft is managed by a propulsion system that 
consists of a main engine and 8 "attitude-control" thrusters. How do these propulsion devices work together 
to safely control the movement of the Surveyor spacecraft? In the initial phases of this spacecraft's design, 
engineers probably asked themselves the following questions to better understand this problem: 

• How do we guarantee that the satellite stays in its orbit and doesn't wonder off into space? 

• How do we characterize the relationship between the available thrust controls and the position of the 
spacecraft? 

• Can we use the knowledge of the satellite's thruster/position relationship to understand how to effi- 
ciently control its movement? 

• By observing the satellite's movement, can we better understand of how the dynamics (memory) of 
the system change with respect to the current and past thruster use? 

• Finally, after understanding the dynamics of the system, can we do something to modify them so that 
the response of the satellite has more desirable properties? 

In this course, we will develop ways to answer these questions. In the beginning, we will take a look at 
linear dynamical systems and determine how to describe their dynamics with a concept known as state. In 
order to examine these dynamics and see how they form relationships between the inputs and outputs of 
a system, differential equations and their frequency-domain counterparts will be studied. After setting this 
foundation, the course material will then focus on concepts found in linear algebra. As many systems have 
multiple inputs and outputs, it makes sense to use matrices and the tools of linear algebra to deal with the 
computations involved in describing them. 

Once these tools are covered, we can use them along with our knowledge of dynamical systems to analyze 
the issues mentioned in the example above; specifically, we will examine system stability, controllability, 
observability, and feedback. With stability, we can see whether the output of a system will remain bounded 
or whether it will "blow up". This is obviously very useful when thinking about the spacecraft above. As 
the name implies, controllability of a system tells us whether or not we can control the output of the system 
without access to the dynamics of the system (i.e. when we can only modify the inputs to the system). The 
third idea, observability, gives us a method of monitoring the output of a system to determine its state. At 
the end of the course, we'll see how feedback can use this information about a system's state to alter the 
system's dynamics in such a way as to improve its properties and response. 

To learn more about the Mars Global Surveyor, visit http://mars.jpl.nasa.gov/mgs/overvu/slides/00.html 2 
. The above image of the MGS was found at http://mars.jpl.nasa.gov/mgs/images/highres.html 3 



2 http://mars.jpl.nasa.gov/mgs/overvu/slides/OO.html 
3 http://mars.jpl.nasa.gov/mgs/images/highres.html 



Chapter 2 

Matrix Inversion 1 



Say that we have the following matrix and that we want to find its determinant. 

/ Oi,i 01,2 •■ • Oi >n \ 

02,1 ^2,2 • • • 0-2,n 
\ (*n,l On,2 • • • On,n / 



(2-1) 



Calculating the determinant of a matrix is a recursive process. Basically, we start by choosing any one row 
or column. The determinant will then be found with respect to this row or column. What this means is that 
we will find a sum of the products of this row or column's values and sub-determinants formed by blocking 
out the row and column of the particular value. 

Why is this choice of row or column left to us instead of always being defined as, say, the first row? The 
reason is that by choosing this row or column wisely, we can sometimes reduce the amount of work we do. 
For example, if a certain row or column contains a few zeros, choosing it as the row/column that we take 
the determinant with respect to would be a smart move. As the values of this chosen row or column will be 
multiplied by sub-determinants of the matrix in question, a value of in one of these products would mean 
that we have one less matrix whose determinant we need to calculate. 

In the case of the matrix above, we'll compute the determinant with respect to the first column. The 
final equation for the determinant is: 

detA = a hl -l 1+1 detA 11 + a 2 ,i-l 2+1 detA 12 + • • • + a nil -l" +1 det^ ln (2.2) 

Here, A 1] means the matrix formed by eliminating the i-th column and the j-th row of A. 

Let's just look at the first term in final equation for determinant (2.2). It is basically the first element 
of A's first column times the determinant of the matrix formed by the elimination of the first row and first 
column of A. There is also a (— l) r c term included. This serves to make the signs of all of the terms in the 
determinant equation fluctuate back and forth. The next term is the same, except that we have moved on 
to the second element in the first column of A. As this element holds a position in the second row and first 
column of A, the sub-determinant in this term is obtained by hiding the second row and first column of A. 

In a generic 3x3 example, we would find the following solution for the determinant: 



lr This content is available online at <http://cnx.Org/content/m2118/2.10/>. 



det 



o 3 idet 



/ a M a 1>2 a 1:3 \ 

0,2,1 ^2,2 ^2,3 
\ &3,1 0,3,2 0-3,3 ) 
a l,2 Ol,3 \ 



«2,2 ^2,3 



a\ idet 



&2,2 &2,3 



a 3,2 0^3,3 
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a 2 idet 



0-1,2 01,3 
03,2 03,3 



(2-3) 



To find the determinants of the 2x2 sub-determinants, we could again apply the rule of the final equation 
for determinant (2.2), keeping in mind that the determinant of a scalar value is simply that scalar value. 
However, it is easier to remember the following solution 



det 



ad — be 



d 



(2.4) 



Example 2.1 

To clarify, take the following example of finding the determinant of a numeric 3x3 matrix. 



/ 1 



V 



-1 2\ 
1 1 
-2 0/ 



(2.5) 



First we need to choose a row or column to take the determinant with respect to. We notice that 
the element in the third row and third column is a zero. Knowing that choosing a row or column 
that contains a zero will reduce our workload, we will choose the third column. Then, by applying 
final equation for determinant (2.2), we get 



&etA = 2 x -l 4 det 



1 



+ 1 x -l 5 det 



1 




(2.6) 



Chapter 3 

Controllability 1 



What do we mean by the term controllability? Simply put, we want to know if we can control the state of 
a system when we only have access to the inputs (i.e. when we can not directly modify the system's state). 
If we can "steer" a system to a certain state by controlling its inputs, we can then ask ourselves if there is a 
way to find the most efficient method of making this transformation. 

3.1 Developing the Concept of a Controllable Space 

Say we have the following system: 

x' = Ax (t) + Bu (t) (3.1) 



Example RLC Circuit 




Rt 



!*• K 



Figure 3.1 



1 This content is available online at <http://cnx.Org/content/m2120/2.13/>. 



CHAPTER 3. CONTROLLABILITY 



X\ 

.v = j In this case, an example controllability question could seek to know if there exists an input 




u such that: x (1ms) = 

\ IA I 

Instead of deriving the general solution for what is called a system's controllable space, X contr , we will 
simply state it and then give a justification for it. 

Formally, X contr is the set of all controllable states. We will define it in terms of a quantity known as 
the controllability matrix, C (A, B): 



C{A,B)=(b AB A 2 B ... A n - X B) 
The controllable space can then be found by taking the image of this matrix. 

X contT = im(C(A,B)) 



(3.2) 



(3.3) 



To justify this expression, we begin with the formal matrix equation for a system's state and substitute 
in the infinite series definition of the matrix exponential. We can then extract the A and B matrices into a 
larger matrix multiplication. 

x = Je A ^ T ^Bu(T)dT 



J (/ + A(t - t) + £{t - rf + . . . ) Bu (r) dr 
Bju{T)dT + ABj i=fu (r) dr + A 2 B J {± ^-u (r) dr + 

( J U {T)dT \ 

( 



B AB A 2 B 



l B 



J(t-T) U (T)dT 



(3.4) 



As the second term in the multiplication is dependent on u, it can be thought of as a free variable. 
Therefore, the set of possible values for x is dependent on the image of first term, which can be seen to be 
the controllability matrix as defined above. 

Continuing the example circuit started above, we can get a better feel for what controllability means. 
Here are the state equations: 

, -1 1 



x\ 



x 2 



Xi 



R X C 

i?2 



-X 2 



R X C 

1 



L J L 

Pulling the A and B matrices out of these equations, we can compute the controllability matrix C (A, B) = 
A AB ) ■ Note that as it is only a second order system, the controllability matrix is only two-dimensional. 



C(A,B) 



RiC (fljC) 2 

1 _R 2 

L L 2 

Immediately, we can understand some things about the system by looking at the rank of the C matrix. 
Let's look at the determinant: detC = T J ^ \ — ^ J — 



TW~C ( — TT + Wc ) ^ ^ ne determinant of the controllability matrix is 
non-zero, then X contr = im (C) = M 2 ; the system is completely controllable. For this to happen we'd need to 



ensure that ^ / -j^-^ . However, if this inequality is not satisfied and the determinant of the controllability 
matrix is 0, then we know that it is not full rank. If it is not full rank, then X contr will not span the entire 
space and the system is not completely controllable. The physical effect here is resonance in the circuit. 
This reduces our controllability matrix to only one dimension (the two columns are linearly dependent). 

X contr = gpan 
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Chapter 4 

The Concept of State 1 



In order to characterize the memory of a dynamical system, we use a concept known as state. 

note: A system's state is defined as the minimal set of variables evaluated at t = to needed to 
determine the future evolution of the system for t > to, given the excitation u (t) for t > t 



Example 4.1 

We are given the following differential equation describing a system. Note that u (t) = 0. 

^ + »(0-o (4.D 

Using the Laplace transform techniques described in the module on Linear Systems with Constant 
Coefficients (Chapter 9), we can find a solution for y (t): 

y(t) = y(t )e t °- t (4.2) 

As we need the information contained in y (to) for this solution, y (t) defines the state. 

Example 4.2 

The differential equation describing an unforced system is: 

d 2 y(t) , d l y(t) 



dt 2 dt 1 

Finding the q (s) function, we have 



+ 2y (*) = (4.3) 



q(s) = s 2 + 3s + 2 (4.4) 

The roots of this function are Ai = — 1 and A2 = —2. These values are used in the solution to the 
differential equation as the exponents of the exponential functions: 

y (t) = c 1 e~ t + c 2 e- 2t (4.5) 

where c\ and c 2 are constants. To determine the values of these constants we would need two 
equations (with two equations and two unknowns, we can find the unknowns). If we knew y(0) 



1 This content is available online at <http://cnx.Org/content/m2104/2. 9/>. 



10 CHAPTER 4. THE CONCEPT OF STATE 

and 4fy(0) we could find two equations, and we could then solve for y(t). Therefore the system's 
state, x(t), is 

\ dt 1 

In fact, the state can also be defined as any two non-trivial (i.e. independent) linear combinations 
of y (t) and f t y (t) . 

NOTE: Basically, a system's state summarizes its entire past. It describes the memory- 
side of dynamical systems. 



Chapter 5 

Controllability and Observability 
Grammians 1 



5.1 Controllability Grammian 

The finite controllability grammian at time t < oo is defined as follows. 



t 

At r> r>* „A"n 



P{t)= / e AT BB*e A T dr (5.1) 

Jo 

This grammian has two important properties. First, P (t) = P* (t) > 0. Secondly, the columns of P (t) 

span the controllable space, i.e. im (P (t)) = im (C (A, B)) It can be shown that the state defined by A and 

B is controllable if, and only if, P (t) is positive definite for some t > 0. 

Using the controllability grammian, we can determine how to most efficiently take a system from the 

zero state to a certain state x . Given that x is in the controllable space, there exists £ such that 



x =Pl T U (5-2) 

for some T > 0. In this case, the minimum energy input required to move the system from zero to x 



A' I T -t) 

is u = B*e \ ) £ If the controllability matrix is invertible, we can use the relation equation 

between £ and certain state (5.2) to put u in terms of x : 

~u~=B*e A V T /p- 1 (t) ~x~ (5.3) 



In general, this minimal energy is exactly equal to £ P [ T I £ . If the system is controllable, 
then this formula becomes 

Energy ( u J = x P^ 1 I T ) x (5.4) 

If you don't want to start at the zero state, the formulas above can still be applied for taking a system at 
state xi to a state x^. This holds even if X\ and x<i are not controllable; in this case, all that is necessary 
is for x 2 — X\ to be in the controllable space. (This makes sense if you think of x\ as being the zero state 
and xi as being the general state we are trying to reach; it is the exact analog of the previous case. Using 
x\ and xi is just like using and x with an appropriate offset.) 



1 This content is available online at <http://cnx.Org/content/m2122/2. 7/>. 
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12 CHAPTER 5. CONTROLLABILITY AND OBSERVABILITY GRAMMIANS 

5.2 Observability Grammian 

The finite observability grammian at time t < oo is defined as 

Q{t)= f e A ' T C*Ce AT dr (5.5) 



o 



Parallel to the finite controllability grammian, the kernel of finite observability grammian is equal to the 
kernel of the observability matrix. (This relationship holds for positive time only.) ker (Q (tj) = ker (O (C, A)) 
Using this grammian, we can find an expression for the energy of the output y at time T caused by the 
system's initial state x: 

Energy (y) = x*Q (T) x (5-6) 



5.3 Infinite Grammians 

Consider a continuous-time linear system defined, as per normal, by the matrices A, B, C, andD. Assuming 
that this system is stable (i.e. all of its eigenvalues have negative real parts), both the controllability and 
observability grammians are defined for t = oo. 

/>oo 

P= e AT BB*e A ' T dr (5.7) 

Jo 

/>oo 

Q = e A * T C*Ce Ar dT (5.8) 

Jo 

These are called the infinite controllability and infinite observability grammians, respectively. These gram- 
mians satisfy the linear matrix equations known as the Lyapunov equations. 

AP + PA* + BB* = (5.9) 

A*Q + QA + C*C=0 (5.10) 

In the case of infinite grammians, the equations for minimal energy state transfer and observation energy 
drop their dependence on time. Assuming stability and complete controllability, the minimal energy required 
to transfer from zero to state x c is 

x c *P- x x c (5.11) 

Similarly, the largest observation energy produced by the state x is obtained for an infinite observation 
interval and is equal to: 

x *Qx (5-12) 



Chapter 6 

Observability 1 



Observability is the tool we use to investigate the internal workings of a system. It lets us use what we know 
about the input u (t) and the output y (t) to observe the state of the system x (t). 

To understand this concept let's start off with the basic state-space equations describing a system: 
x' = Ax + Bu y = Cx + Du If we plug the general solution of the state variable, x (t), into the equation for 
y (t), we'd find the following familiar time-domain equation: 

y (t) = Ce At x (0) + J Ce Mt - T) Bu (r) dr + Du (£) (6.1) 

Jo 

Without loss of generality, we can assume zero input; this will significantly clarify the following discussion. 
This assumption can be easily justified. Based on our initial assumption above, the last two terms on the 
right-hand side of time-domain equation (6.1) are known (because we know u(t)). We could simply replace 
these two terms with some function of t. We'll group them together into the variable y (t). By moving y (t) 
to the left-hand side, we see that we can again group y (t) — yo (t) into another replacement function of t, 
y (t). This result has the same effect as assuming zero input, y (t) = y (t) — y (t) = Ce At x(0) Given the 
discussion in the above paragraph, we can now start our examination of observability based on the following 
formula: 

y (t) = Ce At x (0) (6.2) 

The idea behind observability is to find the state of the system based upon its output. We will accomplish 
this by first finding the initial conditions of the state based upon the system's output. The state equation 
solution can then use this information to determine the state variable x (t). 

base formula (6.2) seems to tell us that as long as we known enough about y (t) we should be able to 
find x (0). The first question to answer is how much is enough? Since the initial condition of the state x (0) 
is actually a vector of n elements, we have n unknowns and therefore need n equations to solve the set. 
Remember that we have complete knowledge of the output y (t). So, to generate these n equations, we can 
simply take n — 1 derivatives of base formula (6.2). Taking these derivatives is relatively straightforward. On 
the right-hand side, the derivative operator will only act on the matrix exponential term. Each derivative of 
it will produce a multiplicative term of A. Then, as we're dealing with these derivatives of y (t) at t = 0, all 
of the exponential terms will go to unity (e A0 = 1). 

y(0) = Cx(0) 

j t y(0) = CAx(0) 



1 This content is available online at <http://cnx.Org/content/m2121/2. 9/>. 
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CHAPTER 6. OBSERVABILITY 



dl 2 



y(0) = CA 2 x(0) 



■n— 1 



A 

— y { 0) = CA^ X (0) 

This can be re-expressed in matrix notation. 



( 2/(0) \ 
rfVg) 

rf 2 v(0) 

dt 2 



CL4 2 



x(0) 



The first term on the right-hand side is known as the observability matrix, a(C, A): 

( C \ 



a(C,A) 



CA 

CA 2 

\ CA"- 1 J 



(6.3) 



We call the system completely observable if the rank of the observability matrix equals n. This 
guarantees that we'll have enough independent equations to solve for the n components of the state x (t). 

Whereas for controllability we talked about the system's controllable space, for observability we will talk 
about a system's unobservable space, X unobs . The unobservable space is found by taking the kernel of the 
observability matrix. This makes sense because when you multiply a vector in the kernel of the observability 
matrix by the observability matrix, the result will be 0. The problem is that when we get a zero result for 
y (t), we cannot say with certainty whether the zero result was caused by x (t) itself being zero or by x (t) 
being a vector in the nullspace. As we cannot give a definite answer in this case, all of these vectors are said 
to be unobservable. 

One cool thing to note is that the observability and controllability matrices are intimately related: 



<r(C,A) T = C(A T ,C T ) 



(6.4) 



Chapter 7 

Diagonalizability 1 



A diagonal matrix is one whose elements not on the diagonal are equal to 0. The following matrix is one 
example. 

/ a \ 
6 
c 



\ d J 

A matrix A is diagonalizable if there exists a matrix V £ M. nxn , detV^ / such that VAV^ 1 
diagonal. In such a case, the diagonal entries of A are the eigenvalues of A. 

Let's take an eigenvalue decomposition example to work backwards to this result. 

Assume that the matrix A has eigenvectors v and w and the respective eigenvalues A„ and A„,: 

Av = X v v 



A is 



A. 



Aw = X w w 
We can combine these two equations into an equation of matrices: 



A( v 



\ v 
X v 

To simplify this equation, we can replace the eigenvector matrix with V and the eigenvalue matrix with 

AV = VA 



Now, by multiplying both sides of the equation by V 1 , we see the diagonalizability equation discussed 
above. 



VAV- 



(7.1) 



When is such a diagonalization possible? The condition is that the algebraic multiplicity equal the geometric 
multiplicity for each eigenvalue, a; = 7». This makes sense; basically, we are saying that there are as many 
eigenvectors as there are eigenvalues. If it were not like this, then the V matrices would not be square, and 
therefore could not be inverted as is required by the diagonalizability equation (7.1). Remember that the 
eigenspace associated with a certain eigenvalue A is given by ker (A — XT). 



1 This content is available online at <http://cnx.Org/content/m2117/2.13/>. 
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16 CHAPTER 7. DIAGONALIZ ABILITY 

This concept of diagonalizability will come in handy in different linear algebra manipulations later. We 
can however, see a time-saving application of it now. If the matrix A is diagonalizable, and we know its 
eigenvalues A,, then we can immediately find the eigenvalues of A 2 : 

A 2 = (VAV- 1 ) (VAV- 1 ) = VA 2 V- 1 

The eigenvalues of A 2 are simply the eigenvalues of A, squared. 



Chapter 8 

Laplace Example 1 



Example 8.1 



RLC circuit 




tl 



=r^ 7,F 



Figure 8.1: RLC circuit 



y(0")=-l 

d 



dl 
df 



y (o-) = 2 
y(0") = -4 



Find the step response for the system above, when u (t) is the input and y (£) is the output (i.e. 
find y (t) for u (t) = step (t)). 

Y (s) = AdmittanceC/ (s) ( 



1.1) 



1.2) 



1.3) 



3.4) 



1 This content is available online at <http://cnx.Org/content/m2109/2.12/>. 
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CHAPTER 8. LAPLACE EXAMPLE 



Admittance = 1 — Impedance 

= l + l-s+l-s + l-l + 2-s (8.5) 

= 2s 3 + 3s 2 + 4s + 2 - s 3 + 2s 2 + s + 2 

Y (s) = (2s 3 + 3s 2 + 4s + 2 - s 3 + 2s 2 + s + 2) U (s) (8.6) 

With our previous definition of q (d — d (£)) y (t) = p (d — d (£)) u (t) we can define the Laplace 
domain equivalents of q and p as: 

q(s) = s 3 + 2s 2 + s + 2 (8.7) 



p(s) = 2s 3 + 3s 2 + 4s + 2 ( 

When we multiply q (s) times Y (s), we have to remember to include terms relating to the initial 
conditions of y(t). We normally think of the Laplace transform of 4+y{t) as sY (s). However, in 
reality, the general transform is as follows: 



£ 



d n y(t) 
dt n 



8 n Y ( S ) - S n -ty (0-) -s 



rfi 1 



d"- 2 y(0-) 



o"' 



d/. 



71-2 



di" 



:iJ/( ") (8-9) 



Therefore, using the initial conditions stated above, we can find the Laplace transforms of the first 
three derivatives of y (£). 



C 



\d 3 y(t)' 




n 3 


dt 3 




C 


\d 2 y(ty 
dt 2 




r 


f^J/W] 




dt 1 



s 3 Y (s) + s 2 



2s- 



(8.10) 



s 2 Y{s) + s 



.11) 



.12) 



sY(s) + 1 

We can now get a complete s-domain equation relating the output to the input by taking the 
Laplace transform of q (d — d (tj) y (t) = p(d — d (£)) u (t). The transform of the right-hand side of 
this equation is simple as the initial conditions of y (t) do not come into play here. The result is 
just the product of p(s) and the transform of the step function (1 — s). 

The left-hand side is somewhat more complicated because we have to make certain that the 
initial conditions are accounted for. To accomplish this, we take a linear combination of Laplace 
transform of the third derivative of y(t) (8.10), Laplace transform of the second derivative of y(t) 
(8.11), and Laplace transform of the first derivative of y(t) (8.12) according to the polynomial q (s). 
That is to say, we use the coefficients of the s terms in q (s) to determine how to combine these 
three equations. We take 1 of Laplace transform of the third derivative of y(t) (8.10) plus 2 of 
Laplace transform of the second derivative of y(t) (8.11) plus 1 of Laplace transform of the first 
derivative of y(t) (8.12) plus 2. 

When we sum these components, collect the Y (s) terms, and set it equal to the right-hand side, 
we have: 

(s 3 + 2s 2 + s + 2) Y (s) + s 2 + 1 = (2s 3 + 3s 2 + 4s + 2) (1 - s) (8.13) 

Rearranging, we can find the solution to Y (s): 

Y (s) = (2s 3 + 3s 2 + 4s + 2 - s 3 + 2s 2 + s + 2) (1 - s) - (s 2 + 1 - s 3 + 2s 2 + s + 2) (8.14) 



19 



This solution can be looked at in two parts. The first term on the right-hand side is the particular 
(or forced) solution. You can see how it depends on p(s) and u(s). The second term is the 
homogeneous (or natural) solution. The numerator of this term describes how the initial conditions 
of the system affect the solution (recall that s 2 + l was the part of the result of the linear combination 
of Laplace transform of the third derivative of y(t) (8.10), Laplace transform of the second derivative 
ofy(t) (8.11), Laplace transform of the first derivative of y(t) (8.12)). The denominator of the second 
term is the q (s) polynomial; it serves to describe the system in general. 
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Chapter 9 

Linear Systems with Constant 
Coefficients 1 

9.1 Analyzing Linear Constant Coefficient Systems 

Constant coefficient linear systems describe LTI systems and form the beginnings of the study of state-space 
systems. In general, an n-th order system such as this can be described by the following differential equation, 
where u and y represent the input and output variables, respectively: 

d n y(t) d n " l y(t) d 1 y(t) , , n d m u(t) n d m ~ 1 u(t) n d 1 u(t) n .. 

(9.1) 

This is a linear differential equation with real- valued constant coefficients on and j3j. We can represent this 

equation with a much more compact notation by thinking of the differential operator as a variable s, where 

the degree of the derivative corresponds to the power of s. We will define q (s) and p (s) as n-th and m-th 

order polynomials in s. 

q (s) = s n + a n _is" -1 + \-ais + a (9.2) 

p (s) = (i m s m + Pm-is™- 1 + --- + PiS + (3 (9.3) 

If we go ahead and say that q (s) and p (s) will take the differential operator as arguments, we can rewrite 
(9.1) as 

'(m) vli>m, (m)' (,) (9 - 4) 

Looking at differential equations in terms of polynomials such as q(s) and p(s) right away reminds us 
the Laplace transform. Using the Laplace transform can often simplify the calculations involved in system 
analysis. 

Example 9.1 

By using Laplace domain tools to examine the RLC circuit seen before, the differential equation 
describing the behavior of this system is easy to deduce. 



'This content is available online at <http://cnx.Org/content/m2103/2.ll/>. 
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CHAPTER 9. LINEAR SYSTEMS WITH CONSTANT COEFFICIENTS 
RLC circuit: 2nd order (Impedances Labeled) 



s,CO 
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/ 
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Figure 9.1: The resistor and inductor in series are combined in the impedance Z\ (s), and the resistor 
and capacitor in parallel form the impedance Z-2 is). 



where 



and 



This yields 



Z 2 (s) 



U(s) Z 1 ( S ) + Z 2 (s) 



Zi (*) = ! + 



Z 2 (s) 



2^3 



(9.5) 



(9.6) 



(9.7) 



Y(s) 



s 2 + ^s + 9 



t/( S ) 



(9i 



By multiplying both sides by the denominator of the fraction and taking the inverse Laplace 
transform, the final differential equation describing the system is determined: 



d*y{t) 7 d}y(t) 
dt 2 2 dt 1 



9y (t) = 6u (t) 



(9.9) 



The results from this example encourage us to apply Laplace techniques to earlier equations in this section. 
By taking the Laplace transform of (9.4), we find that the transfer function of this system is simply the ratio 
of the two polynomials p (s) and q (s). 



9.1.1 Non-zero Initial Conditions 

By saying above that the Laplace transform of -^y (t) is sY (s) we are assuming that the system has zero 
initial conditions . Taking a more general approach, a factor to characterize the initial conditions must be 
included: 



£ 



dy(t) 
dt 



sY(s)-y(0-) 



(9.10) 
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Note: 0~ here means the instant immediately preceding time t = 0; it represents the time right before 
we start paying attention to the system. Also, some readers may be worried that by using y(0~) in this 
equation, we are mixing frequency domain and time domain variables here. However, as y (0 - ) is simply a 
constant, there is no time domain component involved. 

Example 9.2 

Let's look at an example to see how these non-zero initial conditions come into play. A first order 
system is described by the following differential equation: 

—|il + aoy(i) = u(t) (9.11) 

When we take the Laplace transform of the derivative of y (t), we must remember to include a 
term that represents the initial values of the system output. 

sY(s)-y(0-)+a Y( s ) = U(s) (9.12) 

By combining the Y (s) terms we get 

(s + a )Y(s)-y{0-)=U(s) (9.13) 

If we say that q (s) = s + a and p (s) = 1, and define r (s) as y (0~), we can rearrange terms to 
get an expression relating Y (s) to U (s) that takes the initial conditions into account: 

Y(s) = P -^U(s )+ r Jf\ (9.14) 

q(s) q{s) 

What we have here is the Laplace domain solution to a differential equation describing a dynamical 
system. There are two terms in this solution: one that relies on the input and one that does not. 
These parts correspond to the particular and homogeneous solutions, respectively. Taking the 
inverse Laplace transform, we can write (14) as: 

V (t) = 2/part (t) + 2/homo (t) (9.15) 

Here, y par t (i) corresponds to ^nxU (s) and yhomo (t) corresponds to ^W. This makes a lot of sense. 
The particular solution (forced response) depends on a combination of q(s), which describes how 
the system behaves independently, and p(s) U (s), which describes how the system reacts to the 
input U. The homogeneous solution (natural response) depends on a combination of q (s) and r (s), 
the latter of which contains information about the initial conditions of the system. 

Example 9.3 

Let's say that we know the homogeneous solution, y(t), to a differential equation describing a 
system. 

y(t) = e t (9.16) 

Goal: Using this solution, we want to try and figure out the system's q I ^y j function given zero 

initial conditions. 
Solution: 
From above, we know that for a homogeneous solution 

q \d(t), 
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zero initial conditions, r ( -At ) goes to 0: 



We can clear the denominator by moving the q I -S^ j to the left-hand side. And since we have 

\ „™„ ^ n. 

d(t), 

5^)y(*) = o (9.i8) 

The solution can quickly be determined by inspection because we know that the derivative of e* 

is e*. Therefore a solution of q I -^ j = ^4r — 1 would work. However, a more systematic approach 

will be necessary for more difficult situations. We will investigate this approach here. 

Again, we will do our work in the Laplace domain. By equating the Laplace transform of our 
homogeneous solution with the ratio of r (s) and q (s) as discussed above, we have: 

Y(s) = -±r 

S (9 - 19) 

Directly, we can see the solution for q (s): by simply setting the denominators equal to each other, 
q(s) = s — 1. This, of course, is the Laplace transform of the solution of q I ^4r j that we found by 
inspection above. 

Example 9.4 

Now that we have the basics down, we'll look at a more complicated example. We are given 

y (t) = Ae at + Bte bt (9.20) 

Goal: We would like to find the differential equation whose homogeneous solution is y (t). 

Solution: 

Again, we take the Laplace transform of y (t), and then combine the two resultant fractions into 
one ratio of polynomials: 

A | B 



Y(s) -- 

y ' s—a (s — b) 



A{s-by+B(s-a) CQ 911 

(s-a)(s-b) 2 ^- Zl > 

r{s) 



Next, we equate the denominators of the last two fractions to find q(s): 



q (s) = (s - a) (s - b) 

(9.22) 



•s 



3 



(26 + a)s 2 + (b 2 + 2ab) s - ab 2 



Recalling the start of this module, multiplying q (s) by Y (s) and taking the inverse Laplace 
transform will yield the differential equation whose homogeneous solution is y (t): 

^y (t) - (26 + a) ^ + (b 2 + 2ab) ^ - ab 2 y (t) = (9.23) 



Chapter 10 

Dynamical Systems 1 



10.1 "What is a dynamical system?" 

When we talk about systems in the most general sense, we are talking about anything that takes in a certain 
number of inputs and produces a certain number of outputs based on those inputs. 



Generalized System 






,(i) 



->1> 



* v Ci) 



Figure 10.1: Generalized System 



In the figure above, the u (t) inputs could be the jets on a satellite and the y (t) outputs could be the 
gyros describing the "bearing" of the satellite. 

There are two basic divisions of systems: static and dynamic. In a static system, the current outputs are 
based solely on the instantaneous values of the current inputs. An example of a static system is a resistor 
hooked up to a current source: 



lr This content is available online at <http://cnx.Org/content/m2101/2.10/>. 
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Resistor connected to a current source 



tU) & 




Figure 10.2: Resistor connected to a current source 



V (t) = Ri (t) 



(10.1) 



At any given moment, the voltage across the resistor (the output) depends only on the value of the current 
running through it (the input). The current at any time t is simply multiplied by the constant value 
describing the resistance R to give the voltage V. Now, let's see what happens if we replace the resistor with 
a capacitor. 



Simple capacitor connected to a current source 



<'£*; 



tf 






Figure 10.3: Simple capacitor connected to a current 



source 



I(t) = C 



dv (t) 
dt 



Solving for the voltage in the current voltage relationship above, we have: 



v(t)-v(to) 



1 
C 



i (t) dt 



(10.2) 



(10.3) 
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So in the case of the capacitor, the output voltage depends on the history of the current flowing through it. 
In a sense, this system has memory. When a system depends on the present and past input, it is said to be 
a dynamical system. 

10.2 "Describing dynamical systems" 

As seen in voltage-current relationship of a capacitor, differential equations have memory and can thus be 
used to describe dynamical systems. Take the following RLC circuit as an example: 

RLC circuit: 2nd order 



W- ±H 



TJ- 



C 







Figure 10.4: RLC circuit: 2nd order 



In circuits (as well as in other applications), memory elements can be thought of as energy storage 
elements. In this circuit diagram, there are two energy-storing components: the capacitor and the inductor. 
Since there are two memory elements, it makes sense that the differential equation describing this system is 
second order. 

In the most general case of describing a system with differential equations, higher order derivatives of 
output variables can be described as functions of lower order derivatives of the output variables and some 
derivatives of the input variables. Note that by saying "function" we make no assumptions about linearity 
or time-invariance. 

By simply rearranging the equation for the RLC circuit above, we can show that that system is in fact 
covered by this general relationship. 

Of course, dynamical systems are not limited to electrical circuits. Any system whose output depends 
on current and past inputs is a valid dynamical system. Take for example, the following scenario of relating 
a satellite's position to its inputs thrusters. 

10.2.1 "Planar Orbit Satellite" 

Example 10.1 

Using a simple model of a satellite, we can say that its position is controlled by a radial thruster 
u r , which contributes to its vertical motion, and a tangential thruster ug which contributes to its 
motion tangential to its orbit. To simplify the analysis, let's assume that the satellite circles the 
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earth in a planar orbit, and that its position is described by the distance r from the satellite to the 
center of the Earth and the angle 9 as shown in the figure. 

Simple planar orbit satellite example 




* T 7**ii:ii|-t»/ 




?l*H ft r OrLl+ 



Figure 10.5: Simple planar orbit satellite example 



Using the laws of motion, the following set of differential equations can be deduced: 






, , d l r(t) , 



(frit) (feit) felt) 

2 — — — h r — — — = u e 



dt 1 dt 1 



dt 1 



(10.5) 
(10.6) 



Chapter 11 

Cayley-Hamilton Theorem 1 



The Cayley-Hamilton Theorem states that every matrix satisfies its own characteristic polynomial. Given 
the following definition of the characteristic polynomial of A, 

x A (A) = det {XI - A) (11.1) 

this theorem says that x A {A) = 0. Looking at an expanded form of this definition, let us say that 

x A (A) = A n + c^-iA™" 1 + h aiX + a 

Cayley-Hamilton tells us that we can insert the matrix A in place of the eigenvalue variable A and that 
the result of this sum will be 0: 

A n + a n ^ 1 A n ~ 1 H h aiA + a I = 

One important conclusion to be drawn from this theorem is the fact that a matrix taken to a 
certain power can always be expressed in terms of sums of lower powers of that matrix. 

A n = -a n _ 1 A n ~ 1 etiA-a I (11.2) 

Example 11.1 

Take the following matrix and its characteristic polynomial. 

2 1 
1 1 

x A {\) = A 2 -3A+ 1 
Plugging A into the characteristic polynomial, we can find an expression for A 2 in terms of A and 



the identity matrix: 



A 2 - 3A + I = 



equation of characteristic polynomial 

A 2 = 3A-I (11.3) 



1 This content is available online at <http://cnx.Org/content/m2119/2.13/>. 
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To compute A 2 , we could actually perform the matrix multiplication, as below: 



A 2 




5 3 
3 2 



Or taking equation of characteristic polynomial (11.3: equation of characteristic polynomial) to 
heart, we can compute (with fewer operations) by scaling the elements of A by 3 and then sub- 
tracting 1 from the elements on the diagonal. 

5 3 
3 2 




Chapter 12 

Eigenvalue Decomposition 1 



When we apply a matrix to a vector (i.e. multiply them together), the vector is transformed. An interesting 
question to ask ourselves is whether there are any particular combinations of such a matrix and vector whose 
result is a new vector that is proportional to the original vector. In math terminology, this question can be 
posed as follows: if we have a matrix A: K" — » R n , does there exist a vector x € R n and a scalar A G C such 
that Ax = \x? If so, then the complexity of Ax is reduced. It no longer must be thought of as a matrix 
multiplication; instead, applying A to x has the simple effect of linearly scaling x by some scalar factor A. 

In this situation, where Ax = Ax, A is known as an eigenvalue and x is its associated eigenvector. For a 
certain matrix, each one of its eigenvectors is associated with a particular (though not necessarily unique) 
eigenvalue. The word "eigen" is German and means "same"; this is appropriate because the vector x after 
the matrix multiplication is the same as the original vector x, except for the scaling factor. The following 
two examples give actual possible values for the matrices, vectors, and values discussed in general terms 
above. 

/ i _1 \ / 1 \ / i \ 

(12.1) 





Here, | ] is the eigenvector and is its associated eigenvalue. 

j J (12.2) 

In this second example, | is again the eigenvector but the eigenvalue is now 3. 

Now we'd like to develop a method of finding the eigenvalues and eigenvectors of a matrix. We start with 
what is basically the defining equation behind this whole idea: 

Ax = \x (12.3) 

Next, we move the Aa; term to the left-hand side and factor: 

(A-XI)x = (12.4) 

Here's the important rule to remember: there exists x ^ satisfying the equation if and only if 
det (A — XT) = 0. So, to find the eigenvalues, we need to solve this determinant equation. 



1 This content is available online at <http://cnx.Org/content/m2116/2. 9/>. 
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Example 12.1 

Given the matrix A, solve for A in det (A — XI) = 0. 



2 1 
1 2 



(12.5) 




det (A - XI) = 

= (A-2) 2 -l (12-6) 

= A 2 - 4A + 3 
= 

A = {3,1} (12.7) 

After finding the eigenvalues, we need to find the associated eigenvectors. Looking at the defining equation 
(12.4), we see that the eigenvector x is annihilated by the matrix A — XI. So to solve for the eigenvectors, 
we simply find the kernel (nullspace) of A — XI using the two eigenvalues we just calculated. If we did this 

for the example above, we'd find that the eigenvector associated with A = 3 is I and the eigenvector 

. 1 

associated with A = 1 is 

-1 

You may be wondering why eigenvalue decomposition is useful. It seems at first glance that it is only 
helpful in determining the effect a matrix has on a certain small subset of possible vectors (the eigenvectors). 
However, the benefits become clear when you think about how many other vectors can be looked at from an 
eigenvalue perspective by decomposing them into components along the available eigenvectors. For instance, 

(*\ 

in the above example, let's say we wanted to apply A to the vector . Instead of doing the matrix 

v° ' 
I A 

multiply (admittedly not too difficult in this case) , the vector could be split into components in the 





direction of the eigenvalues: 




! + L\ 



(12.6 



Now, each of these components could be scaled by the appropriate eigenvalue and then added back together 
to form the net result. 

12.1 Multiplicity 

Once we have determined the eigenvalues of a particular matrix, we can start to discuss them in terms 
of their multiplicity. There are two types of eigenvalue multiplicity: algebraic multiplicity and geometric 
multiplicity. 
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Definition 12.1: Algebraic Multiplicity 

The number of repetitions of a certain eigenvalue. If, for a certain matrix, A = {3,3,4}, then the 
algebraic multiplicity of 3 would be 2 (as it appears twice) and the algebraic multiplicity of 4 would 
be 1 (as it appears once). This type of multiplicity is normally represented by the Greek letter a, 
where a (Aj) represents the algebraic multiplicity of Aj. 

Definition 12.2: Geometric Multiplicity 

A particular eigenvalue's geometric multiplicity is defined as the dimension of the nullspace of XI— A. 
This type of multiplicity is normally represented by the Greek letter 7, where 7 (Aj) represents the 
geometric multiplicity of Aj. 

12.2 Helpful Facts 

Here are some helpful facts about certain special cases of matrices. 

12.2.1 Rank 

A matrix A is full rank if detA ^ 0. However, if A = then det (XI - A) = 0. This tells us that det^4 = 0. 
Therefore, if a matrix has at least one eigenvalue equal to 0, then it cannot have full rank. Specifically, for 
an n-dimensional square matrix: 

• When one eigenvalue equals 0, rank (^4) = n — 1 

• When multiple eigenvalues equal rank (A) = n — 7(0). This property holds even if there are other 



non-zero eigenvalues 



12.2.2 Symmetric Matrices 

A symmetric matrix is one whose transpose is equal to itself (A = A T ). These matrices (represented by A 
below) have the following properties: 

1. Its eigenvalues are real. 

2. Its eigenvectors are orthogonal. 

3. They are always diagonalizable. 



34 CHAPTER 12. EIGENVALUE DECOMPOSITION 



Chapter 13 

Generating Sets and Bases 



Given {xi, . . . , x k } G R, we can define a linear space (vector space) X as 

X = span({cci,.. . ,x k }) 

= { Z)»=l a i x i \<Xi&M.\ 



(13.1) 



In this case, {xi, . . . ,x k } form what is known as a generating set for the space X. That is to say that 
any vector in X can be generated by a linear combination of the vectors {xi, . . . , x k }- 

If {x\, . . . ,Xk} happen to be linearly independent, then they also form a basis for the space X. When 
{x\, . . . ,Xfe} define a basis for X, k is the dimension of X. A basis is a special subset of a generating set. 
Every generating set includes a set of basis vectors. 

Example 13.1 

The following three vectors form a generating set for the linear space IR 2 . 

( l \ ( l \ ( 2 

I 1 J W I 1 

It is obvious that these three vectors can be combined to form any other two dimensional vector; 
in fact, we don't need this many vectors to completely define the space. As these vectors are not 
linearly independent, we can eliminate one of them. Seeing that X3 is equal to x\ + X2, we can get 
rid of it and say that our basis for K 2 is formed by x\ and x^. 



1 This content is available online at <http://cnx.Org/content/m2114/2. 9/>. 
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Chapter 14 

Matrix Exponential 1 



Since systems are often represented in terms of matrices and solutions of system equations often make use 
of the exponential, it makes sense to try and understand how these two concepts can be combined. In many 
previous applications, we've seen terms like e at come in handy for talking about system behavior. Here, a 
was always a scalar quantity. However, what would happen if the scalar a was replaced by a matrix A? The 
result would be what is known as the matrix exponential. 

14.1 Definition 

Recall the definition of the scalar exponential: 



„ot i , „ * i „2^ 



2 + 3 



e aJ = l + a - + ^- + a J - + ... (14.1) 

The definition of the matrix exponential is almost identical: 

e At = I n + A t - + A^ + A^ + ... (14.2) 

Where A is n x n and I n is the n x n identity matrix. While it is nice to see the resemblance between 
these two definitions, applying this infinite series does not turn out to be very efficient in practice. However, 
it can be useful in certain special cases. 

Example 14.1 

At ( 1 \ 

Compute e where A = . We can start by taking powers of A so that we can use the 

V" 1 v 

formal definition. 

A=\ ^ J | (14.3) 



1 This content is available online at <http://cnx.Org/content/m2112/2.10/>. 
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1 \ I 1 

-1 J \ -1 

-1 

-1 



(14.4) 



A 3 = A 2 A 
= -A 

A 4 = A 2 A 2 
= I 

A b = AA 2 
= A 

A 6 = A 2 A 4 
= -I 

A i(n-1) + 1 = A 
A 4(n-l)+2 = _j 
A 4(n-l)+3 = _ A 

A A(n-l)+A = j 

If we fill in the terms in the definition of e at , we'll get the following matrix: 



And so the pattern goes, giving: 



2! "T" 4! 


t- 


3! "+" 5! 


t 3 t 5 , 
3! 5! "'" • ' 


. 1 - 


t 2 , t 4 

2! "I" 4! 



(14.5) 
(14.6) 
(14.7) 
(14.8) 

(14.9) 
(14.10) 
(14.11) 
(14.12) 



(14.13) 



We notice that the sums in this matrix look familiar- in fact, they are the Taylor Series expansions 
of the sinusoids. Therefore, the solution further reduces to: 



„At 



cos (t) sin (t) 
—sin (t) cos (£) 



(14.14) 
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14.2 General Method 

The example above illustrates how the use of the true definition to simplify matrix exponentials might only 
be easily applied in cases with inherent repetition. There is a more general method involving the Laplace 
Transform. In particular, 

C[e At ] = {si -Ay 1 (14.15) 

We can verify that this is true by inserting the formal definition of the matrix exponential: 

L[e At ] = c[l + A±+A% + ...~\ 

= i/+li+li 2 + ... (14.16) 

= (si -Ay 1 

The jump between the third and fourth equations here may be a bit hard to believe, but this equality 
reduces to I = I when both sides are multiplied by si — A. Taking an inverse Laplace of each side of Laplace 
Transform of the equation (14.15) we find an expression for the matrix exponential: 

e At = C~ x ((si - A)" 1 ) (14.17) 

Example 14.2 

We can do the same example as before, this time using the Laplace-based method. 

■*= ! I I (14.18) 



(si -Ay 1 




(14.19) 



Taking the inverse laplace of this gives us 



i, = | cos(i) sin(i) 

-sin (t) cos (t) 



(14.20) 



14.3 Properties of the Matrix Exponential 

In the scalar case, a product of exponentials e a e b reduces to a single exponential whose power is the sum of 
the individual exponents' powers, e a+b . However, in the case of the matrix exponential, this is not true. If 
A and B are matrices, 

e A e B / e A+B (14.21) 
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unless A and B are commutative (i.e. AB = BA) 

The derivative operates on the matrix exponential the same as it does on the scalar exponential. 

£(e At ) = + A + A^+A 3 ^ + ... 



A (l + A^+A 2t ^ + ...) (14.22) 



Ac 



A I. 



Chapter 15 

Laplace Properties and Transforms 1 



15.1 Laplace Properties 



£[/(*)] 



F(s) 
J~f(t)e-Wdt 



(15.1) 



Property 


Time-domain 


Frequency-domain 


Linearity 


o/i (t) + bh (t) 


oFi (t) + bF 2 (t) 


Shifting in s-domain 


e Sot f{t) 


F (s - s ) 


Time Scaling (a > 0) 


f{at) 


(l-a)F(s-a) 


Convolution (causal functions) 


h it) * h it) 


Fi (s) F 2 (s) 


Differentiation in Time 


if it) 


sF(s)-f(0-) 


Differentiation in Freq. 


-itfit)) 


£ F is) 


Integration in Time 


Io-fir)dr 


(l-s)F(s) 



Figure 15.1 



15.2 Unilateral Laplace Transforms 

Note: I (t) is a step function. 

1 This content is available online at <http://cnx.Org/content/m2110/2. 9/>. 
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Time-domain 


Frequency-domain 


6(t) 


1 


I(t) 


l 

s 


tl(t) 


1 

s 2 


t n I{t) 


s n + l 


e at I{t) 


1 

s — a 


te at I(t) 


1 


(s-af 


cos (at) I (t) 


s 


s 2 +a 2 


sin (at) I (t) 


a 


s 2 -\-a 2 



Figure 15.2 



Chapter 16 

Laplace Domain Solutions to State and 
Output Equations 1 



As always, it is useful to look at the solutions to the state and output equations from a Laplace domain 
perspective. We start with the general forms of the state and output equations. 

x'(t) = Ax + Bu (16.1) 

y = Cx+Du (16.2) 

Let's take a look at the state equation. In the time-domain version of this analysis, we had to use a 
combination of derivatives and integrals to find the solution x (t) . Making an analogy to Laplace-domain 
equations, we know that derivatives and integrals in time equate to multiplies and divides in frequency. So, 
we suspect that finding the Laplace-domain solution X (s) might be significantly easier. We will start by 
taking the Laplace transform of the state equation. 

C [x' (t) = Ax + Bu] (16.3) 

sX(s)-x(0) = AX(s) + BU(s) (16.4) 

If we collect the X (s) terms on the left-hand side, we can come up with 

(sI-A)X(s)=x(0) + BU(s) (16.5) 

We see immediately that we the solution for X (s) is staring us in the face. All we have to do is get the 
si — A to the other side. Remembering that this term is actually a matrix, we know we can't just divide 
through by it; instead, we left-multiply both sides of the equation with the inverse of this term. This yields 

X (s) = (si - A)~ 1 x (0) + (si - A)~ 1 BU (s) (16.6) 

If we take the time-domain solution for x (t) found before, we can take its Laplace transform and arrive at 
this same result. 



C 



x(t) = e At x(0)+ e A{t - T) Bu(r)dT 



X(s) (16.7) 



You can see how this equation would transform into X(s) result equation. We know that the Laplace 
transform of the matrix exponential is (si — A)~ . The first term is simply this quantity times the scalar 



1 This content is available online at <http://cnx.Org/content/m2108/2. 8/>. 
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EQUATIONS 

x(0). Since the integral term has the form of a convolution, the Laplace-domain equivalent is simple a 
multiplication. 

Finding the Laplace-domain output equation solution is just as easy. Again, we start by taking the 
Laplace transform of the output equation. This gives us 

Y(s) = CX(s) + DU(s) (16.8) 

You might be thinking that this is the end result: we have an expression for Y (s). However, we must 
remember that we want these solutions to be in terms of known quantities. Namely, these quantities are the 
initial conditions and the inputs. So what we need to get rid of is the X (s) term. Fortunately, we just found 
an expression for X (s) in terms of the initial conditions and the inputs. Plugging in that equation into the 
output equation solution, we get 



Y 



(s) = C ((si - A)~ 1 x (0) + {si - Ay 1 BU 0)) + DU (s) (16.9) 

When we multiply the C through and collect the U (s) terms, we get a final expression for the output 
equation solution: 

Y(s)=C ({si - A)~ 1 x (0)) + (c(sl - A)~ 1 B + DJU (s) (16.10) 

It is interesting to note that the two addends in this equation represent the free response (the initial condition 
term) and the forced response (the input term) of the system. 



Chapter 17 

Time Domain State and Output 
Equations 1 



note: x and u are functions of time, and the notation Jj {x) implies -^x (t). 
Given the state equations and output equations 

— x(t) = Ax + Bu (17.1) 

at 

y = Cx+Du (17.2) 

we would like to be able to find solutions for x and y in terms of the initial state of the system and the 
system's input. To find such solutions, we begin with an examination of a scalar (n = 1, m = 1) state 
equation: 

— x (t) = ax + bu (17-3) 

If we looked at a special case of this equation, one where the input u was 0, we'd have j^x (t) = ax. We've 
seen this many times before; to solve this, we need a function whose derivative is directly proportional to 
itself. This function is the exponential function. Therefore, in solving the more general case presented by 
the state equation (17.3), we expect that the exponential function will also come into play. 

Starting with the state equation (17.3), we can collect like terms, multiply through by e~( at \ and rewrite 
the left-hand side of the derivative equation (17.4) in terms of the derivative. (We take this last step after 
noticing that the left-hand side of the derivation equation (17.4) looks like the derivative product rule has 
already been applied to it.) 

e -(»t) ^1 - ae-^x (t) = be^u (t) (17.4) 

— ( e~ (at) x (tj) = e'^bu (t) (17.5) 

at \ ) 

Since we are searching for x (t) instead of its derivative, we will integrate both sides from to to t. 

'■ t d 1 e-^x{t) dt= [ l e -(at) hu{t)dt (1?6) 

to dt J t 
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In the left-hand side of this equation, the integral and the derivative counteract each other and we are left 
with the difference of the function e~( at ^x (t) evaluated at the upper and lower integration limits. To avoid 
confusion, the variable of integration will be changed from t (which is now a constant limit in the integral) 
to T. 



e -^x(t)-e- ( - ato) x(t )= e- {aT hu{T)dT (17.7) 

J t 

We now move the x (to) term to the other side and divide through by e~^ at \ This leaves us with a solution 
for the state variable x (t) in the scalar case: 

x (t) = e a (*-'°)x {t ) + f e a{t ~ T hu (r) dr (17.8) 



What happens if we let t g° to — oo? The first term on the right-hand side will go to zero since x (— oo) = 0. 
Then, if we say that h (t) = e at b, the second term can be rewritten as 

t 

h{t-T)u{T)dT (17.9) 

-oo 

This is the convolution equation h * u. 

For the scalar case, the solution to the output equation y (t) has the same basic form as the solution to 
the state equation: 

y (t) = ce a{t - ta) x {t ) + f ce a{t - T) bu (r) dr + d(u (t)) (17.10) 

J t 

Again, we can see the convolution in the second term. 

The general matrix forms of the solutions for the state and output equations follow the same pattern. 
The only differences are that we use the matrix exponential instead of the scalar exponential, and that we 
use the matrices A, B, C, and D instead of the scalars a, b, c, and d. 

x (t) = e At x (0) + [ e A{t ~ T) Bu (r) dr (17.11) 

Jo 

y (t) = Ce At x (0) + [ Ce A{t - T) Bu (r) dr + Du (t) (17.12) 

Jo 

The convolution term is easy to see in the solution for x (t). However, it takes a little regrouping to find it 
in the solution for y (t). If we pull the D matrix into the integral (by multiplying it by the impulse function, 
8, we once again have the integral of a function of t — r being multiplied by the input (convolution). 



(t) = Ce At x (0) + / (Ce A{t ' T) B + D5 (t - r)) u (r) dr (17.13) 



Chapter 18 

Matrix Inversion 1 



Let's say we have the square n x n matrix A composed of real numbers. By "square", we mean it has the 
same number of rows as columns. 

/ 01,1 • ■ • ai„ \ 



A 



(18.1) 



y O n ^i . . . O nn / 



The subscripts of the real numbers in this matrix denote the row and column numbers, respectively (i.e. 
ai : 2 holds the position at the intersection of the first row and the second column). 

We will denote the inverse of this matrix as A -1 . A matrix inverse has the property that when it is 
multiplied by the original matrix (on the left or on the right), the result will be the identity matrix. 



AA- 



A- l A 
I 



(18.2) 



To compute the inverse of A, two steps are required. Both involve taking determinants ( detA) of 
matrices. The first step is to find the adjoint ( A H ) of the matrix A. It is computed as follows: 



\H 



C*l,l 


• • ■ «l,n 


\ a n ,i 


• • • ^n.n J 


, = -1 


'+MetA ij 



(18.3) 



(18.4) 



where A li is the (n — 1) x (n — 1) matrix obtained from A by eliminating its i-th column and j-th row. 
Note that we are not eliminating the z-th row and j-th column as you might expect. 

To finish the process of determining the inverse, simply divide the adjoint by the determinant of the 
original matrix A . 

1 



A- 1 



\H 



detA 



(18.5) 
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Example 18.1 



a b 
c d 

Find the inverse of the above matrix. 

The first step is to compute the terms in the adjoint matrix: 



Therefore, 

d -b 



\ — c a 



(18.6) 



a hl = -l 2 d (18.7) 

a 1;2 = -l 3 6 (18.8) 

a 2 ,i = -l 3 c (18.9) 

a 2 2 = -l 4 a (18.10) 



(18.11) 



We then compute the determinant to be ad — be. Dividing through by this quantity yields the 
inverse of A: 

t , 1 / d -b . 

A =^d-v c \ i < 18 - 12 ) 



Chapter 19 

Matrix Representation of Systems 1 



19.1 State Equations 

Knowing that a system's state describes its dynamics, or memory, it is also useful to examine how the state 
of a system evolves over time. A system's state will vary based on the current values of the state as well as 
the inputs to the system: 

^ + y(*) = o (19-D 

Looking at an example will help to see why calculating the time- varying behavior of the state is important. 

Example 19.1 

A system is described by the following differential equation: 



d 2 y(t) d 2 y(t) , , , 

-|U + 3-|U + 2y(,)=0 (19.2) 



The state of this system is 



xit) 



Xl(t) 
32 (t) , 

(19.3) 

y(t) 

dt 1 

The state x (t) (a vector) is composed of two state variables X\ (t) and x-i (t). We would like to 
be able to talk about the time- varying state in terms of these state variables. That is, we'd like an 
expression where j^x (t) can be written in terms of x\ (t) and X2 (t). From state equation (19.3) 
above, we see that 4zX\ (t) simply equals j^y{t). In the same equation we also notice that 4fy(t) 
equals jj^xi it). Therefore, the derivative of the first state variable exactly equals the second state 
variable. 

&*(*) = ivM (194) 

= x 2 (t) 

We can follow the same process for x 2 (t). Again from state equation (19.3), we see that the first 
derivative of x 2 (t) equals the second derivative of y (t). At this stage, we can bring in information 



1 This content is available online at <http://cnx.Org/content/m2106/2.ll/>. 
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from the system's differential equation. That equation (the first one in this example) also contains 
the second derivative of y (t). If we solve for it we get 



J 2 



y(t) 



,^2/W 



2y (t) + u (t) 



dt 2aw dt 1 

We already know that -^y (t) equals X2 (£) and that y (t) equals x\ (t). Putting all of this together, 
we can get an expression for 4iX2 (t) in terms of the state variables and the input variable. 



(19.5) 



fc*(t) 



= "3^ -2y (*)+«(*) (19-6) 

= -3x 2 (t)- 2xi (t) + u(t) 

The important thing to notice here is that by looking at the time- varying behavior of the state, we 
have been able to reduce the complexity of the problem. Instead of one second-order differential 
equation we now have two first-order differential equations. 

Think about a case where we might have 5, 10, or even 20 state variables. In such an instance, 
it would be difficult to work with so many equations. For this reason (and in order to have a more 
compact notation), we represent these state variable equations in terms of matrices. The set of 
equations above can be written as: 








By letting x (t) 



xi (t) 

x 2 (t) 



,A 




(19.7) 



we can rewrite this equation as: 



-x (t) = Ax (t) + Bu (t) 



(19i 



This is called a state equation. 

State equations are always first-order differential equations. All of the dynamics and memory of the system 
are characterized in the state equations. In general, in a system with n state variables and m inputs, A is n 
x ri, x (t) is n x 1, B is n x m, and u (t) ismxl. 

State Equation Matrices 



nji\ 



r 



A 



rvfiy) 



I 



t 



y\Z I 



5 



B 



ny 1 ! Ktf[ 



Figure 19.1: State Equation Matrices 
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19.2 Output Equations 

Now that we've seen how to examine a system with respect to its state equations, we can move on to 
equations defining the relationships between the outputs of the system and the state and input variables. 
The outputs of a system can be written as sums of linear combinations of state variables and input variables. 
If in the example above the output y (t) depended only on the first state variable, we could write y (t) in 
matrix form: 

y(t) = xi (t) 

More generally, we can express the output (or outputs) as: 

y (t) = Ax (t) + Du (t) (19.10) 

In a system with m inputs, n state variables, and p outputs, y (t) is p x 1, C is p x n, x (t) is n x 1, D is p x 
m, and u (t) is n x 1. Output equations are only algebraic equations; there are no differential equations and 
therefore, there is no memory component. 

If we assume that m = p = 1 and D = 0, we can elininate x (t) in a combination of the state equations 
and output equations to get the input/output relation q(d— d(tj)y (t) = p(d — d(t))u (t). Here the degree 
of q equals the degree of p. 

Example 19.2 

Let's develop state and output equations for the following circuit diagram: 

Example Circuit 1 

■ 

» wL-^j — j -* < 

/ '* 'Uti J J_ + 



^ 



X 




Figure 19.2: Example Circuit 1 



There are two energy-storage elements in this diagram: the inductor and the capacitor. As we 
know that energy-storage elements give systems memory, it makes sense that the state variables 
should be the current ii, flowing through the inductor and the voltage vc across the capacitor. By 
using Kirchoff's laws around the left and center loops, respectively, we can find the following two 
equations: 

u = i L -l d ^ + v c (19.11) 

dt 

dvc 
i L = v c -2-l^- (19.12) 
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These equations can easily be rearranged to have the derivatives on the left-hand side equaling 
linear combinations of state variables and inputs on the right. These are the state equations. The 
figure also quickly tells us that the output y is equal to the voltage across the capacitor, vq- 
We can now rewrite the state and output equations in matrix form: 

(19.13) 



(19.14) 



19.3 Compact System Notation 

We now introduce one more simple way to simplify the representation of systems. Basically, to better use 
the tools of linear algebra, we will put all four of the matrices from the state and output equations (i.e., A, 
B, C, and D) into one large partitioned matrix: 




Compact System Matrix Notation 



tf\ 



r 



a * 



c £> 



Figure 19.3: Compacty System Matrix Notation 



Example 19.3 

In this example we'll find the state and output equations for the following circuit, as well as 
represent the system using the compact notation described above. 
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Example Circuit 2 



X. 



t ~nm- i } 





Figure 19.4: Example Circuit 2 



C t 



Here, u and y are the input and output currents, respectively. x\ and xi are the state variables. 
Using Kirchoff 's laws and the i-v relation of a capacitor, we can find the following three equations: 



u = y + Xi 
dx 2 



Xi = A- 



dl 



(19.15) 
(19.16) 



Ry = C 



dxi 



dl 



Xi 



(19.17) 



Through simple rearranging and substitution of the terms, we find the state and output equations: 
State equations: 



d 

di. 



(x\) = —1x2 — R{u — X\) 



dl 



{x 2 ) = {l-A) Xl 



Output equation: 



y = —x\ + u 
This equations can be more compactly written as: 



A B 
A D 



( 

V 



{-R)-L -l-L 
I- A 

1 



R-L 






/ 



(19.18) 
(19.19) 

(19.20) 
(19.21) 
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Example 19.4 

The simple oscillator is defined by the following differential equation: 



fy 

dt 



2 +y = u 



(19.22) 



The states are x\ = y (which is also the output equation) and x 2 = -i (y). These can be rewritten 
in state equation form as: 



ell 



(xi) = x 2 



dt. 



The compact matrix notation is: 



A B 
A D 



{x 2 ) = —X\ + u 



' ( 1 
-1 
1 



(19.23) 
(19.24) 



1 





(19.25) 



Chapter 20 

Defining the State for an n-th Order 
Differential Equation 1 

Consider the n-th order linear differential equation: 

q(s)y(t)=p(s)u(t) (20.1) 

where s = -^ and where 

q (s) = s n + o^-is™" 1 H \- ais + a (20.2) 

P (s) = p n - 1 s n - 1 + --- + (3 1 s + f3 (20.3) 

One way to define state variables is by introducing the auxiliary variable w which satisfies the differential 
equation: 

q(s)w(t) = u(t) (20.4) 

The state variables can then be chosen as derivatives of w . Furthermore the output is related to this 
auxiliary variable as follows: 

y(t)=p(s)w(t) (20.5) 

The proof in the next three equations shows that the introduction of this variable w does not change the 
system in any way. The first equation uses a simple substition based on the differential equation (20.4). Then 
the order of p(s) and q(s) are interchanged. Lastly, y is substituted in place of p(s)w(t) (using output 
equation (20.5)). The result is the original equation describing our system. 

p (s) q (s) w (t) = p (s) u (t) (20.6) 

q(s)p(s)w(t) =p(s)u(t) (20.7) 

q(s)y(t)=p( S )u(t) (20.8) 
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DIFFERENTIAL EQUATION 



Using this auxiliary variable, we can directly write the A, B and C matrices. A is the companion-form 
matrix; its last row (except for a in the first position) contains the alpha coefficients from the q (s): 

\ 



(20.9) 



f o 


1 

















1 

























\ — a —a\ —a 2 —otz 
The B vector has zeros except for the n-th row which is a 1. 

/o\ 





B 



C can be expressed as 



C 



( A) \ 

Pi 
fa 



When all of these conditions are met, the state is 



/ 



?r 



s 2 w 



\ 



\ s n ~ 1 w ) 



*n-l J 



(20.10) 



(20.11) 



(20.12) 



In conclusion, if the degree of p is less than that of q, we can obtain a state-space representation by inserting 
the coefficcients of p and q in the matrices A, B and C as shown above. 



Chapter 21 

Partial Fraction Expansion 1 



Splitting up a ratio of large polynomials into a sum of ratios of small polynomials can be a useful tool, 
especially for many problems involving Laplace-like transforms. This technique is known as partial fraction 
expansion. Here's an example of one ratio being split into a sum of three simpler ratios: 

8x 2 + 3x - 21 _ 1 3 4 

a; 3 — 7x — 6 x + 2 x — 3 x + 1 

There are several methods for expanding a rational function via partial fractions. These include the 
method of clearing fractions, the Heaviside "cover-up" method, and different combinations of these two. 
For many cases, the Heaviside "cover-up" method is the easiest, and is therefore the method that we will 
introduce here. For a more complete discussion, see Signal Processing and Linear Systems by B.P. Lathi, 
Berkeley-Cambridge Press, 1998, pp-24-33. Some of the material below is based upon this book. 

21.1 Heaviside "Cover- Up" Method 

21.1.1 No Repeated Roots 

Let's say we have a proper function G (x) = -jyn^ (by proper we mean that the degree m of the numerator 
N (x) is less than the degree p of denominator D (x) ). In this section we assume that there are no repeated 
roots of the polynomial D (x). 

The first step is to factor the denominator D (x): 

G (x) = N{X) - (21.2) 

(x - ai) (x - a 2 ) . . . (x - a p ) 

where a\ . . . a p are the roots of D (x). We can then rewrite G (x) as a sum of partial fractions: 

G{x) = — + — + ••• + v — (21.3) 

x — a\ x — ai x — a p 

where a\ . . . a p are constants. Now, to complete the process, we must determine the values of these a 
coefficients. Let's look at how to find a\. If we multiply both sides of the equation of G(x) as a sum of 
partial fractions (21.3) by x — a\ and then let x = Oi, all of the terms on the right-hand side will go to zero 
except for a\. Therefore, we'll be left over with: 

ai = (x- ai )G(x)\ x=ai (21.4) 



1 This content is available online at <http://cnx.Org/content/m2111/2.14/>. 
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We can easily generalize this to a solution for any one of the unknown coefficients: 

a r = (x - a r ) G (x) \ x=ar (21.5) 

This method is called the "cover-up" method because multiplying both sides by x — a r can be thought of 
as simply using one's finger to cover up this term in the denominator of G (x). With a finger over the term 
that would be canceled by the multiplication, you can plug in the value x = a r and find the solution for a r . 

Example 21.1 

In this example, we'll work through the partial fraction expansion of the ratio of polynomials 
introduced above. Before doing a partial fraction expansion, you must make sure that the ratio 
you are expanding is proper. If it is not, you should do long division to turn it into the sum of a 
proper fraction and a polynomial. Once this is done, the first step is to factor the denominator of 

the function: 

8a; 2 + 3a; - 21 _ 8a; 2 + 3a; - 21 

a; 3 - 7x - 6 ~ (x + 2) (x - 3) (x + 1) ( ' ' 

Now, we set this factored function equal to a sum of smaller fractions, each of which has one of 
the factored terms for a denominator. 

8a; 2 + 3x - 21 "1,0:2, 0:3 , 91 _.. 

(21. 7) 



(x + 2) (x - 3) (x + 1) a; + 2 x - 3 x + 1 

To find the alpha terms, we just cover up the corresponding denominator terms in G (x) and 
plug in the root associated with the alpha: 



21 = 


(x + 2)G(x)U_ 2 


= 


8a; 2 +3a;-21 i 
(x-3)(x+l) \x=-2 


= 


1 


a 2 = 


(x-3)G(x)\ x=3 


= 


8x 2 +3a;-21 1 
(a;+2)0+l) \x=3 


= 


3 


13 = 


(x + 3)G(x)\ x= _ 1 


= 


8ie 2 +3ie-21 1 
(x+2)(x-3) \x=-l 


= 


4 



(21.6 



(21.9) 



(21.10) 



We now have our completed partial fraction expansion: 

8a; 2 + 3x - 21 1 3 



(x + 2)(x-3)(x + l) x + 2 



(21.11) 
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21.1.2 Repeated Roots 

When the function G (x) has a repeated root in its denominator, as in 

G (x) = -r-, f (3:) (21.12) 

(x — o) (x — a\) (x — 02) . . . (x — cij) 

Somewhat more special care must be taken to find the partial fraction expansion. The non-repeated 
terms are expanded as before, but for the repeated root, an extra fraction is added for each instance of the 
repeated root: 

G x = 7 T^ + 7 TT73T + ---+ Z + + + ••• + — 21.13 

(x — b) (x—b) x — b x — Oi x — a 2 x — a,j 

All of the alpha constants can be found using the non-repeated roots method above. Finding the beta 
coefficients (which are due to the repeated root) has the same Heaviside feel to it, except that this time we 
will add a twist by using the derivative to eliminate some unwanted terms. 

Starting off directly with the cover-up method, we can find j3q. By multiplying both sides by (x — b) r , 
we'll get: 

(a; - b) r G (x) = A) + fa {x - b) + ■ ■ ■ + r -i(x - hf' 1 + ai (x - 6) + a 2 {x ~ h) + ■■■ + a j ^ - h) (21.14) 

x — oi x — a 2 x — cij 

Now that we have "covered up" the (x — b) r term in the denominator of G (x), we plug in x = b to each 
side; this cancels every term on the right-hand side except for /3 , leaving the formula 

(3 =(x-b) r G(x)\ x=b (21.15) 

To find the other values of the beta coefficients, we can take advantage of the derivative. By taking the 
derivative of the equation after cover-up (21.14) (with respect to x the right-hand side becomes /3± plus terms 
containing an x — b in the numerator. Again, plugging in x = b eliminates everything on the right-hand side 
except for f3i, leaving us with a formula for /3i: 

fa= d{X 'Z G{X) \^ (21-16) 

Generalizing over this pattern, we can continue to take derivatives to find the other beta terms. The 
solution for all beta terms is 

1 d k (x-b) r G(x), 

note: To check if you've done the partial fraction expansion correctly, just add all of the partial 
fractions together to see if their sum equals the original ratio of polynomials. 

21.2 Finding Partial Fractions in Matlab 

Matlab can be a useful tool in finding partial fraction expansions when the ratios become too unwieldy to 
expand by hand. It can handle symbolic variables. For example, if you type syms s, s will be treated as a 
symbolic variable. You can then use it as such when you make function assignments. 

If you've done this and have then made a function, say H (s), which is a ratio of two polynomials in the 
symbolic variable s, there are two ways to get the partial fraction expansion of it. A trick way is to say 
dif f (int (H) ) . When you use these functions together, Matlab gives back H expanded into partial fractions. 
There's also a more formal way to do it using the residue command. Type help residue in Matlab for 
details. 
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Chapter 22 

Linear Time Invariant Systems 1 



22.1 Introduction 

Linearity and time invariance are two system properties that greatly simplify the study of systems that exhibit 
them. In our study of signals and systems, we will be especially interested in systems that demonstrate both 
of these properties, which together allow the use of some of the most powerful tools of signal processing. 

22.2 Linear Time Invariant Systems 
22.2.1 Linear Systems 

If a system is linear, this means that when an input to a given system is scaled by a value, the output of the 
system is scaled by the same amount. 

Linear Scaling 



x * 



-*- y 



ax ^ 



-*■ ay 



(a) 



(b) 



Figure 22.1 



In Figure 22.1(a) above, an input x to the linear system L gives the output y. If x is scaled by a value 
a and passed through this same system, as in Figure 22.1(b), the output will also be scaled by a. 

A linear system also obeys the principle of superposition. This means that if two inputs are added 
together and passed through a linear system, the output will be the sum of the individual inputs' outputs. 



1 This content is available online at <http://cnx.Org/content/m2102/2.24/>. 
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xi *. 



-*- yi 



^2 *■ 



■+- w 



(a) 



(b) 



Figure 22.2 



Superposition Principle 



3!i +yi 



■*- ^a + y% 



Figure 22.3: If Figure 22.2 is true, then the principle of superposition says that Figure 22.3 (Superpo- 
sition Principle) is true as well. This holds for linear systems. 



That is, if Figure 22.2 is true, then Figure 22.3 (Superposition Principle) is also true for a linear system. 
The scaling property mentioned above still holds in conjunction with the superposition principle. Therefore, 
if the inputs x and y are scaled by factors a and /3, respectively, then the sum of these scaled inputs will 
give the sum of the individual scaled outputs: 



axi *. 



-*- ayi 



p** — *- 



■*■ Pvz 



(a) 



(b) 



Figure 22.4 
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Superposition Principle with Linear Scaling 



QXi + fix% *■ 



-* ayi + ftyz 



Figure 22.5: Given Figure 22.4 for a linear system, Figure 22.5 (Superposition Principle with Linear 
Scaling) holds as well. 



Example 22.1 

Consider the system Hi in which 

H 1 (f(t)) = tf(t) (22.1) 

for all signals /. Given any two signals /, g and scalars a, b 

Hi (af (t) + bg (*)) = t (af (t) + bg (*)) = atf (t) + big (t) = offi (/ (t)) + bH, (g (t)) (22.2) 

for all real t. Thus, Hi is a linear system. 

Example 22.2 

Consider the system Hi in which 

H 2 (f(t)) = (f(t)f (22.3) 

for all signals /. Because 

H 2 (2i) = At 2 =£ 2t 2 = 2H 2 (t) (22.4) 

for nonzero t, H 2 is not a linear system. 



22.2.2 Time Invariant Systems 

A time-invariant system has the property that a certain input will always give the same output (up to 
timing), without regard to when the input was applied to the system. 
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Time-Invariant Systems 



r(t) 



TI 



■*¥(*) 



b(* - *o) 



TI 



■*■ y(* - *n) 



(a) 



(b) 



Figure 22.6: Figure 22.6(a) shows an input at time t while Figure 22.6(b) shows the same input 
to seconds later. In a time-invariant system both outputs would be identical except that the one in 
Figure 22.6(b) would be delayed by to- 



In this figure, x (t) and x (t — t ) are passed through the system TI. Because the system TI is time- 
invariant, the inputs x (t) and x (t — to) produce the same output. The only difference is that the output 
due to x (t — to) is shifted by a time to. 

Whether a system is time-invariant or time- varying can be seen in the differential equation (or difference 
equation) describing it. Time-invariant systems are modeled with constant coefficient equations. 
A constant coefficient differential (or difference) equation means that the parameters of the system are not 
changing over time and an input now will give the same result as the same input later. 



Example 22.3 

Consider the system Hi in which 



for all signals /. Because 



H 1 (f(t)) = tf(t) 



S T (ffi (/ (t))) = S T (tf (t)) = (t -T) f (t - T) / tf (t -T) = H x (f (t - T)) = H x (S T (f (t))) 
for nonzero T, Hi is not a time invariant system. 

Example 22.4 

Consider the system Hi in which 

H 2 (f(t)) = (f(t)f 
for all signals /. For all real T and signals /, 

St (H 2 (f (t))) = S T (f(tf) = (f (t - T)f = H 2 (f (t - T)) = H 2 (S T (f (*))) 
for all real t. Thus, H 2 is a time invariant system. 



(22.5) 
(22.6) 



(22.7) 
(22.8) 



22.2.3 Linear Time Invariant Systems 

Certain systems are both linear and time-invariant, and are thus referred to as LTI systems. 
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Linear Time-Invariant Systems 



r.(t) 



LTI 



■*»(*) 



r(*-to) 



LTI 



■*■ ay(* -*n) 



(a) 



(b) 



Figure 22.7: This is a combination of the two cases above. Since the input to Figure 22.7(b) is a scaled, 
time-shifted version of the input in Figure 22.7(a), so is the output. 



As LTI systems are a subset of linear systems, they obey the principle of superposition. In the figure 
below, we see the effect of applying time-invariance to the superposition definition in the linear systems 
section above. 



3!l(*) > 



LTI 



■*■ Wl(t) 3!a(*) *■ 



LTI 



■*»(*) 



(a) 



(b) 



Figure 22.8 



Superposition in Linear Time-Invariant Systems 



axi(t-ti) +f3xi(t-ti) *■ 



LTI 



■+ ayL(t-h)+Pva(t-ti) 



Figure 22.9: The principle of superposition applied to LTI systems 



22.2.3.1 LTI Systems in Series 

If two or more LTI systems are in series with each other, their order can be interchanged without affecting 
the overall output of the system. Systems in series are also called cascaded systems. 
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Cascaded LTI Systems 



#1 



Hi 



(a) 



Hi 



H 



(b) 

Figure 22.10: The order of cascaded LTI systems can be interchanged without changing the overall 
effect. 



22.2.3.2 LTI Systems in Parallel 

If two or more LTI systems are in parallel with one another, an equivalent system is one that is defined as 
the sum of these individual systems. 



Parallel LTI Systems 







H L 


| 










* 


H 2 



H^+Hi 



(a) (b) 

Figure 22.11: Parallel systems can be condensed into the sum of systems. 
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Example 22.5 

Consider the system H 3 in which 

H 3 (f(t)) = 2f(t) (22.9) 

for all signals /. Given any two signals /, g and scalars a, b 

H 3 (af (t) + bg (t)) = 2 (af (t) + bg (*)) = a2f (t) + b2g (t) = aH 3 (f (*)) + bH 3 (g (*)) (22.10) 

for all real t. Thus, H 3 is a linear system. For all real T and signals /, 

S T (H 3 (f (*))) = S T (2/ (*)) = 2/ (t - T) = H 3 (f (t - T)) = H 3 (S T (/ (*))) (22.11) 

for all real t. Thus, H 3 is a time invariant system. Therefore, H 3 is a linear time invariant system. 

Example 22.6 

As has been previously shown, each of the following systems are not linear or not time invariant. 

H 1 (f(t)) = tf(t) (22.12) 

H 2 (f(t)) = (f(t)f (22.13) 

Thus, they are not linear time invariant systems. 

22.3 Linear Time Invariant Demonstration 



Image not finished 



Figure 22.12: Interact (when online) with the Mathematica CDF above demonstrating Linear Time 
Invariant systems. To download, right click and save file as .cdf. 



22.4 LTI Systems Summary 

Two very important and useful properties of systems have just been described in detail. The first of these, 
linearity, allows us the knowledge that a sum of input signals produces an output signal that is the summed 
original output signals and that a scaled input signal produces an output signal scaled from the original 
output signal. The second of these, time invariance, ensures that time shifts commute with application of 
the system. In other words, the output signal for a time shifted input is the same as the output signal for the 
original input signal, except for an identical shift in time. Systems that demonstrate both linearity and time 
invariance, which are given the acronym LTI systems, are particularly simple to study as these properties 
allow us to leverage some of the most powerful tools in signal processing. 
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Chapter 23 

I/O and I/S/O Relationships in Time 
and Frequency 

23.1 I/O and I/S/O representation of SISO linear systems 



I/O 



I/S/O 



variab leeariables : (u,x,y) 
(u,y) 



-u 



dp 
Hi 

deg (qh 
deg (p) 



(0 



=j§a: (t) = Az (£) + Bu (t) ,y(t) = Cx (t) + Du (t) 

,n = 
> 



A B 
O j-J 



Impulse Response 


%Ht) = p(t) 


h(t) = DS{t) + Ce At B,t > 


H(s) = £[h(t)} = ^ 


H{s) = D + C(sI-A)~ 1 B 



Poles - characteristic roots - eigenfrequencies 



A,, q (A;) = 0, 7 = 1, . . . , n det (A;7 - A) = 



Zeros 



H(zi) = 0-&p(zi),l,...,n 



det 



zj - A -B 
-C -D 



Matrix exponential 


(e At = Er=o U") =* (1 (e*) = A** = 


= e A4 A) 


£[e At ] = 07-A) _1 



1 This content is available online at <http://cnx.Org/content/ml0511/2.5/>. 
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CHAPTER 23. I/O AND I/S/O RELATIONSHIPS IN TIME AND 

FREQUENCY 



BIBO stability 



y = (ft, w), requirement 



3Vu : u : ((|| u |l < oo) =* ((«)„, < oo)) 



«■ (ft) x = / °° | ft (t) \dt < oo 



<=> 3? (A,) < ^ poles € LHP 



Solution in the time domain 


2/ (*) = 2/zi (t) + y zs (t) 


X (t) = x zi (t) + x zs (t) 


V (t) = E"=i C ^ A '< + /„*_ h(t-r)u (r) rfr 


x (t) = e At x (0-) + / *_ e A ( f - T '5« (r) dr 




j/(t) = Ce A *x(0-) + 
/„*_ (£>J (t - r) + Ce A (*- T )B) u (r) dr, ft (•) 




y (t) = Ce At x (0-) + /„'_ h(t-r)u (r) rfr 



Laplace Transform: Solution 


in the frequency domain 


y( 5 ) = iM + jff ( s )C/( 5 ) 


X (s) = (si - Ay x x (0") + (s/ - A) _1 SC/ (s) 




y(«) = C(*7- A) _1 x(0-) + 
(l> + C(sI- Ay 1 B\u{s),H{s) = D + 

C(sl- Ay l B 



Table 23.1 



23.2 Definition of state from I/O description 



Let H(s) = D 



?W 



(*--( 



deg P < deg (g). Define w so that |fw (i) = u (t), [y(t) = ^rw + Du (t) 



, x T = ( w w 1 



„n-l 



n : degree of g (s). 



23.3 Various Responses 

Definition 23.1: Zero-input or free response 

response due to initial conditions alone. 

Definition 23.2: Zero-state or forced response 

response due to input (forcing function) alone (zero initial condition) 

Definition 23.3: Homogeneous solution 

general form of free- response (arbitrary initial conditions). 

Definition 23.4: Particular solution 

forced response. 

Definition 23.5: Steady-state response 

response obtained for large balues of time T — > oo. 

Definition 23.6: Transient response 

full response minus steady minus state response. 
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Glossary 



A Algebraic Multiplicity 

The number of repetitions of a certain eigenvalue. If, for a certain matrix, A = {3, 3, 4}, then the 
algebraic multiplicity of 3 would be 2 (as it appears twice) and the algebraic multiplicity of 4 
would be 1 (as it appears once). This type of multiplicity is normally represented by the Greek 
letter a, where a (A,) represents the algebraic multiplicity of Aj. 

G Geometric Multiplicity 

A particular eigenvalue's geometric multiplicity is defined as the dimension of the nullspace of 
XI — A. This type of multiplicity is normally represented by the Greek letter 7, where 7 (Aj) 
represents the geometric multiplicity of Aj. 

H Homogeneous solution 

general form of free-response (arbitrary initial conditions) . 

P Particular solution 

forced response. 

S Steady-state response 

response obtained for large balues of time T — > 00. 

T Transient response 

full response minus steady minus state response. 

Z Zero-input or free response 

response due to initial conditions alone. 
Zero-state or forced response 

response due to input (forcing function) alone (zero initial condition). 
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